Category: Technical
-
Mechanistic Interpretability and Sparse Autoencoders
Mechanistic interpretability and sparse autoencoders will allow us to do something that to date we’ve not been able to accomplish. Debug the hidden layer of AI. Mechanistic interpretability and sparse autoencoders addresses this. Mechanistic Interpretability A new field of research has emerged called Mechanistic Interpretability (often called mech interp). In our new world of AI,…
-
AI Technical Flow Part 3
Part 3: Output We’ve arrived at the output. What you and I can see once the AI has processed our requests. The output not only consists of the generated response, but also shows a variety of output channels, or where the output gets routed to. What I like most about this flow is it’s iterative…
-
AI Technical Flow Part 2
Part 2 : Processing We’ll now take a look at part 2. Processing. It’s very easy to get lost in the complexity of what occurs here. I promised to keep my articles high level. This is no exception. To learn more about the mathematics involved, there are plenty of web-sites and books you can dive…
-
AI Technical Flow Part 1
Part 1 of 3: Input Let’s take a little mystery out of AI. I promised early on to keep it high level. This won’t be any different, except it will get a little more technical. Don’t worry, I won’t dive deeply into the algorithms involved, a little mystery will remain. Basic Technical Flow Modified Technical…