• 3 Posts
  • 112 Comments
Joined 9 months ago
cake
Cake day: February 24th, 2025

help-circle
  • Had to read “Animal, Vegetable, Miracle” for an environmental science class, which is what initially got me interested in gardening. That prompted me to read “Gaia’s Garden,” which is a permaculture book. I like a lot of the basic principles of permaculture, but a lot of stuff isn’t science or evidence based, and a lot of stuff is taken from indigenous practices without acknowledging it.













  • I think there’s a massive oversupply of software engineers world-wide, and investors and executives are heavily pushing offshoring to countries where there are even more engineers that are even more desperate to find work. The ideology or focus of the entire US investor/executive class seems to have shifted as soon as Musk gutted Twitter. I fear this may be another, “these jobs aren’t coming back,” kind of thing the manufacturing industry went through. Perhaps we’ll see a boom of bootstrapped start-ups ran by engineers (or preferably worker-cooperatives), but that’s extremely hard to do.


  • I think tool calling is just a form of structured output, where the LLM outputs something like json that describes the function to call and the arguments, then you parse that and run the function with the arguments, then feed the output back to the LLM in a new message, if you want. IDK the specific details, I’m guessing there are some special tokens some LLMs produce for tool calling, and I’m also guessing there is “controlled generation” (masking the logits/tokens, and only choosing to generate the tokens that would be valid). Ollama apparently doesn’t support the special tool-calling tokens or output structure that some models use.

    This is how it looks when using OpenAI compatible APIs: https://platform.openai.com/docs/guides/function-calling?api-mode=responses.

    I’ve never heard of TabbyAPI (I’m new to using local models, in general). I’m also not sure what TabbyAPI brings over Ollama, llama.cpp, or vLLM. So would be curious as well.

    Edit: For my little toy project I’m working on, I’m switching to not using tool-calling at all, and building a LangGraph and using structured output, which should be more reliable with my use-case. I.e. just always call the tool manually, feed the output back to the LLM to have the LLM evaluate if the output was correct, retry calling the tool with different arguments if not, and just fail after 5 calls.

    I like watching Yannic Kilcher, to keep up with some of the newer developments, and read various papers. I do have a background in ML (mostly the more traditional, non-generative, supervised learning and reinforcement learning) though.


  • 10001110101@lemm.eetoScience Memes@mander.xyz2025 be vibin'
    link
    fedilink
    English
    arrow-up
    4
    ·
    5 months ago

    I think this is only a small part. Interest rates are kinda high. VCs only want to invest in companies with AI exposure because of all the hype. From companies I’ve interviewed with, offshoring seems to have accelerated dramatically (companies only had or wanted a few US devs to manage larger Indian teams). I’ve visited career pages of companies working in the business domain I have the most experience with, and all open software positions are exclusively in India.


  • 10001110101@lemm.eetoScience Memes@mander.xyz2025 be vibin'
    link
    fedilink
    English
    arrow-up
    9
    ·
    5 months ago

    I have over a decade of experience as well. Nobody in my small personal “network” knows anyone that’s hiring right now (I hate the fakeness of networking for networking sake, and am not very social, so I don’t have much of a network). I’ve applied to hundreds of job postings over 6 months, interviewed with maybe 6 companies, and rejected usually just because they were also interviewing 10-20 people for the same role, and another person had slightly more experience with a specific part of their stack, or they just liked another person more for whatever reason. I believe all remote job postings get 1000s of applicants, and every one local to me get 100s.

    It all kind of reminds me of when I tried using online dating apps, lol.



  • Idk, the author of “Civil Disobedience” did it. It’s a valid resistance method, or just a way to keep yourself morally consistent. Every kind of resistance has a good chance of bringing harm to yourself.

    I personally didn’t file one year; kinda just kept putting it off because I knew I wouldn’t be able to pay my taxes (was a 1099 worker, and suffered some major financial blows that year); nothing ever happened, but it definitely was a risk. I probably won’t do that as an “act of resistance” next year, but will probably try extending as long as possible.