And many other things. I am pretty sure we are in the infancy of voice commands but what about from a single device? Would it be easy for the average person to set up with like youtube videos and such?

  • ThePowerOfGeek@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    4
    ·
    edit-2
    14 days ago

    Is it possible? In many ways, yes. Combining a cutting-edge LLM with something like OpenClaw and lots of IoT (Internet of Things) connectivity, it could do a lot of what Jarvis does. At least in managing a building and doing some chores for a human locally.

    Is it a good idea? Arguably hell no! LLMs are remarkable, but they have blind spots. Notably with being exploited and gamed by malicious players. Or just in making strange decisions or hallucinating shit. And there have already been a lot of horror stories about OpenClaw-enabled LLMs either getting exploited or just unilaterally doing detrimental things under (mostly) good intentions, and leaking PII or bank details or similar. Then you factor in all the security holes that IoT devices can be prone to, and the expenses of buying all the needed technology, and paying for all those LLM API tokens. Not to mention the environmental concerns of using a very powerful cloud-based LLM. I’m probably forgetting some other negatives too.

    ETA: If you’re going to try creating a Jarvis type system for home automation and sooner online tasks, really make sure you take security and financial precautions. Don’t give it access to bank accounts and sensitive PII, ensure limits are in place for token usage, be very specific with any prompts you use, and for the love of God lock all devices and systems down behind really strong passwords/passphrases and (where possible) MFA that goes directly and only to you on a separate device or number.