• 0 Posts
  • 21 Comments
Joined 9 months ago
cake
Cake day: October 2nd, 2023

help-circle
  • Don’t forget that its much more effort than teaching a child, sometimes no matter your words, the machine can be stubborn. It is a very difficult and misunderstood profession, sometimes my head aches a little from typing the same thing over again, expecting a different result. But together we will hallucinate the future, engineering one word at a time.





  • Oh dont even get me started on modded Minecraft, I’m really not sure what makes it worse for alt tabbing over just older versions, maybe its just selection bias, but it’s like one mod can decide that it no longer wants to go fullscreen, and I don’t think its fabric/forge

    KSP was another one that was just kinda finicky, I think it got better with patches



  • You may find the need for 3 different aspect ratios, just to be sure you’re doing the whole user interface thing right. Judge if you like but here I still need to have multiple workspaces and stacked windows, so clearly the extra retail space works. Or its obnoxious and I’m merely coping.

    Also fuck games that still dont work with alt tab in this day and age


  • Gramps needed his excel icon - on the monitor I might add - or else. Debloat and activation scripts got him his windows 7 and office 2007 experience back, he was very appreciative of my “hack”, merely for the same experience he paid for back some 15 years.

    He doesn’t know what a “Linux” is, but I am greatful that people are still invested enough to make utilities to return back to a more user centric experience in windows - even if I certainly don’t care to go back




  • We do not have a rigorous model of the brain, yet we have designed LLMs. Experts of decades in ML recognize that there is no intelligence happening here, because yes, we don’t understand intelligence, certainly not enough to build one.

    If we want to take from definitions, here is Merriam Webster

    (1)

    : the ability to learn or understand or to deal with new or trying >situations : reason

    also : the skilled use of reason

    (2)

    : the ability to apply knowledge to manipulate one’s >environment or to think abstractly as measured by objective >criteria (such as tests)

    The context stack is the closest thing we have to being able to retain and apply old info to newer context, the rest is in the name. Generative Pre-Trained language models, their given output is baked by a statiscial model finding similar text, also coined Stocastic parrots by some ML researchers, I find it to be a more fitting name. There’s also no doubt of their potential (and already practiced) utility, but a long shot of being able to be considered a person by law.


  • I don’t want to spam this link but seriously watch this 3blue1brown video on how text transformers work. You’re right on that last part, but its a far fetch from an intelligence. Just a very intelligent use of statistical methods. But its precisely that reason that reason it can be “convinced”, because parameters restraining its output have to be weighed into the model, so its just a statistic that will fail.

    Im not intending to downplay the significance of GPTs, but we need to baseline the hype around them before we can discuss where AI goes next, and what it can mean for people. Also far before we use it for any secure services, because we’ve already seen what can happen


  • Building my own training set is something I would certainly want to do eventually. Ive been messing with Mistral Instruct using GPT4ALL and its genuinely impressive how quick my 2060 can hallucinate relatively accurate information, but its also evident of limitations. IE I tell it I do not want to use AWS or another cloud hosting service, it will just return a list of suggested services not including AWS. Most certainly a limit of its training data but still impressive.

    Anyone suggesting to use LLMs to manage people or resources are better off flipping a coin on every thought, more than likely companies who are insistent on it will go belly up soon enough


  • The fallout of image generation will be even more incredible imo. Even if models do become even more capable, training off of post-'21 data will become increasingly polluted and difficult to distinguish as models improve their output, which inevitably leads to model collapse. At least until we have a standardized way of flagging generated images opposed to real ones, but I don’t really like that future.

    Just on a tangent, openai claiming video models will help “AGI” understand the world around it is laughable to me. 3blue1brown released a very informative video on how text transformers work, and in principal all “AI” is at the moment is very clever statistics and lots of matrix multiplication. How our minds process and retain information is by far more complicated, as we don’t fully understand ourselves yet and we are a grand leap away from ever emulating a true mind.

    All that to say is I can’t wait for people to realize: oh hey that is just to try to replace talent in film production coming from silicon valley