Innovation

Note: The continuing adventures of ‘a dozen people asked what I thought about a new AI model in work so I put them together and republished it a few months later when I got a quiet weekend’… So, Deepseek stripped billions from the market on Monday. Do we care? My 2c is that this is a fantastic series of innovations on the core design of LLMs, and based on those innovations, I wouldn’t be surprised if the training costs quoted as being in the mid-to-high-single-digit-millions-of-dollars are around the right order of magnitude for this (assuming you already had the team expertise of a PhD fueled quant-hedge fund in house and didn’t pay them SV salaries). ...

This talk was originally prepared for the 2020 Northern Ireland Developers Conference, held in lockdown and pre-recorded in the McKee Room in Farset Labs Intro Data Science is the current hotness. While those of us in these virtual rooms may make fun of the likes of Dominic Cummings for extolling a ‘Data Driven Approach’ to policy, the reality is that Data Science as a buzzword bingo term has survived and indeed thrived in a climate where ‘Artificial Intelligence’ is increasingly derided as being something that’s written more in PowerPoint than Python, ‘Machine Learning’ still gives people images of liquid metal exoskeletons crushing powdery puny human skulls, and those in management with long memories remember what kind of mess “Quantitative Analysis” got us into not too long ago… ...

Approximate Script from my #NIDevConf19 talk a few weeks ago Introduction The technology community is known for being strongly inward looking to the point of being miopic at times; we focus on techniques, products, languages, frameworks, and best practices and we consider success and failure based on concrete facts and evidence. ...

See Part 1 for an introduction to this series. Response to Part 1 Two things came out of my posting of Part 1; I was “strongly encouraged” to have a look at the evidence pack as well as the initial strategy document (unfortunately changing what was intended to be a 3-part break down into more like a 8 part). So I’ll plod on through the rest of the strategy as read and then go through the evidence pack and see what got lost in the wash. ...

I’m leaving Northern Ireland, and I’m moving to Liverpool. Via Portsmouth. I have spoken with a few people about the situation I find myself in, and a few more people about my decision, but I want to get it all down somewhere. Where did this come from? The short answer is that a series of unexpected events mean that it makes sense to move my research. Recently, my PhD supervisor, Prof Alan Marshall, was offered a research Chairship at the University of Liverpool, which he gladly accepted. It’s a great move for him (Another Russell Group, one of the original ‘redbrick’ universities, etc etc), but that’s his life not mine so all it does is provide an option. (Disclosure: I also work with Alan on his spinout Wireless Security company, TOM Ltd) ...

Open on Industrial Stairwell, Camera pans, looking up into the darkness. A soft, diffuse, but intimidating light creeps over the top step. With an apprehensive cadence, the viewer lollups up the staircase, turning as ceiling gives way to floor to peer over the long, dark, hardwood that makes up the expanse of floor, (beaten worn by industrial revolution, then caked in dust, then scraped clean in sections by Aeron chairs, ping-pong tables and feature lightning, before being scraped back over again by the repo-men), towards five chairs, the mix of which look as if they belong in a time-travellers’ garage ...

I was sitting in Sinnamon on the Stranmillis Road, enjoying a coffee, a sausage roll, and my Kindle, reading the latest 2600. One article immediatly stood out to me, ‘A World Spinning’. The main focus of the article was the world-changing domino effect, toppling regimes across the middle east, all caused by one, little textfile. The textfile in question was a US Embassy cable highlighting the indemic corruption in the (ex) Tunisian Government. As most know, this leak was from WikiLeaks; a rag-tag loosely knit chaotic alliance of hackers across the globe, all with the the same general aim to allow open and plain discourse and stopping governments across the globe from hiding secrets from their citizenry; big secrets and small… Of course, as with most things to do with hackers, the aim isn’t that simple; having spoken to some of those involved, it was abundantly clear that some elements within Wikileaks purely want to screw with governments that (they feel have) wronged them, but others are simply motivated by the cat-and-mouse challenge of acquiring, validating, securing and releasing information in a hostile environment. ...

Just under a month after ordering, with a shipping schedule fraught with manufacturing delays and pushed-back dispatch dates (Not complaining, I’m not the only one so everyone was shocked by the demand also) I recieved my new UK kindle 3g at 11 this morning. Immediately I loaded some math-loaded PDF’s which the free.amazon.com document converter handled with ease, then started going through my usual list of sites on the free 3G network, Twitter (largley fine but sluggish), Facebook (buggy with regards to javascript elements, occasionally freezing completely needing to be latched-off and on again) Google-Apps Mail(constantly refreshing and wouldn’t load stably), google reader (worked perfectly out of the box including keyboard shortcuts, which are awesome!) and my ToDo list of late, TeuxDeux (sluggish and slightly misaligned, but usable) ...

Contrary to popular belief, the concept of a ‘hacker’ (or at least self described ones) has very little to do with coding and networking wizards pounding through systems and stealing valuable information or just destroying everything they touch. In fact, Google (and Princeton University’s) first definition of the word has more to do with Golf than security (try it by googling “define:hacker”). The so called ‘hacker subculture’ is usually taken as a group of not necessarily like minded, but creative individuals with or without technical or theoretical skill, including artists, musicians, carpenters, machinists, or extreme knitters, and can generally be shortened down to ’tinker-ers’ or ‘messers’.Belfast is a growing hub of technology, software, and art of all forms within Europe; and with Londonderry being named the ‘City of Culture’ for 2013, it is clear the Northern Ireland is no longer (or never was?) the poor child of British (and Irish) creativity and excellence. ...

It’s that time again where the big project that is Farset Labs is in need of another Director, and I thought this was as good a time as any to give my personal take on why I think it’s important to bring in more “Direction”, as well as a little “behind the scenes” perspective on how the position actually operates. My relationship with Farset is a long and close one, but this time I’m speaking not as the charity, just me. ...