this post was submitted on 10 Jun 2024
-6 points (12.5% liked)

Technology

69298 readers
3938 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
-6
Andrej Karpathy endorses Apple Intelligence (lemmy.world)
submitted 10 months ago* (last edited 10 months ago) by Z4rK@lemmy.world to c/technology@lemmy.world
26 comments fedilink hide all child comments
 

Actually, really liked the Apple Intelligence announcement. It must be a very exciting time at Apple as they layer AI on top of the entire OS. A few of the major themes.

Step 1 Multimodal I/O. Enable text/audio/image/video capability, both read and write. These are the native human APIs, so to speak.

Step 2 Agentic. Allow all parts of the OS and apps to inter-operate via "function calling"; kernel process LLM that can schedule and coordinate work across them given user queries.

Step 3 Frictionless. Fully integrate these features in a highly frictionless, fast, "always on", and contextual way. No going around copy pasting information, prompt engineering, or etc. Adapt the UI accordingly.

Step 4 Initiative. Don't perform a task given a prompt, anticipate the prompt, suggest, initiate.

Step 5 Delegation hierarchy. Move as much intelligence as you can on device (Apple Silicon very helpful and well-suited), but allow optional dispatch of work to cloud.

Step 6 Modularity. Allow the OS to access and support an entire and growing ecosystem of LLMs (e.g. ChatGPT announcement).

Step 7 Privacy. <3

We're quickly heading into a world where you can open up your phone and just say stuff. It talks back and it knows you. And it just works. Super exciting and as a user, quite looking forward to it.

https://x.com/karpathy/status/1800242310116262150

top 26 comments
sorted by: hot top controversial new old
[–] AverageGoob@lemmy.world 2 points 10 months ago (3 children)

Yikes. Just hit em with the ol' "<3" for privacy. Does not inspire confidence.

[–] eager_eagle@lemmy.world 3 points 10 months ago

#trustmebro

<3

[–] reattach@lemmy.world 1 points 10 months ago

I thought the original post was satire - list all of the privacy issues, then throw in "Privacy <3" at the end. Seriously, almost every one of those points has a potential privacy issue.

Guess I was being too generous.

[–] Z4rK@lemmy.world 0 points 10 months ago (1 children)

How so? Many people want to use AI in privacy, but it’s too hard for most people to set it up for themselves currently.

Having AI tools on the OS level so you can use it in almost any app and that is guaranteed to be processed on device in privacy will be very useful if done right.

[–] TheFriar@lemm.ee 1 points 10 months ago

You think your iPhone isn’t collecting data on you? Is that what you’re saying?

[–] someacnt_@lemmy.world 2 points 10 months ago (1 children)

This isn't satire? What?

[–] admin@lemmy.my-box.dev 0 points 10 months ago (1 children)

Check out OP defending Apple in every comment in this thread. It would be funny if it weren't so... yeah.

[–] someacnt_@lemmy.world 1 points 10 months ago

I am just sitting here like.. how. Am I too autistic to distinguish satire from non-satire ones

[–] c10l@lemmy.world 2 points 10 months ago

Founding member of company that stands to make fortunes through a product endorses said product.

[–] JoMiran@lemmy.ml 2 points 10 months ago (2 children)

[–] eager_eagle@lemmy.world 1 points 10 months ago

twitter

[–] LANIK2000@lemmy.world 1 points 10 months ago

The amount of corporate speak makes me sick. Especially the mix of buzzwords being mixed with shit like "KERNEL PROCESS", shit's cursed.

[–] WorldsDumbestMan@lemmy.today 1 points 3 months ago

Now just need one of those headsets that read your vocal cord movements in order to "read your thoughts", and I can silently make the AI do anything.

[–] duuuurtymike@lemm.ee 1 points 1 month ago

NONE of the features on this list are in Apple Intelligence. Apple AI is such a flop. They released the iPhone 16 lineup saying it’s for Apple AI and it’s not even going to be released on them for at least another year. What a fail.

[–] eager_eagle@lemmy.world 1 points 10 months ago (1 children)

"and it just works"

has he even used an llm before?

[–] Z4rK@lemmy.world 0 points 10 months ago (1 children)

He sort of invented it, so you have to think he’s commenting on the concept here, not the implementation.

I have tried a lot of medium and small models, and there it just no good replacement for the larger ones for natural text output. And they won’t run on device.

Still, fine-tuning smaller models can do wonders, so my guess would be that Apple Intelligence is really 20+ small and fine tuned models that kick in based on which action you take.

[–] gravitas_deficiency@sh.itjust.works 0 points 10 months ago (1 children)

An LLM has no comprehension of what it says. It’s just a puppy that is really good at performing for treats. This will always yield nonsense a meaningful proportion of the time.

I don’t care how statistically good your model can be under certain constraints and inputs. At the end of the day, all you’ve done is classically condition your computer.

[–] Z4rK@lemmy.world 1 points 10 months ago

It goes a tad bit beyond classical conditioning... LLM’a provides a much better semantic experience than any previous technology, and is great for relating input to meaningful content. Think of it as an improved search engine that gives you more relevant info / actions / tool-suggestions etc based on where and how you are using it.

Here’s a great article that gives some insight into the knowledge features embedded into a larger model: https://transformer-circuits.pub/2024/scaling-monosemanticity/

[–] henfredemars@infosec.pub 1 points 10 months ago* (last edited 10 months ago) (1 children)

Kernel process LLM

God I hope not. That sounds extremely insecure. Definitely do not do this in the kernel.

[–] Thann@lemmy.ml 2 points 10 months ago (1 children)

Why not just have the LLM replace the kernel?

[–] rikudou@lemmings.world 1 points 10 months ago

What the hell is the fella smoking if he thinks Apple would ever let others use their on-device LLM? Like, the company that deems it too dangerous if apps could change a wallpaper?

[–] restingboredface@sh.itjust.works 1 points 10 months ago

I look forward to Apple Marketing coming up with their usual line of nonsense, like a meaningless name for an existing capability that they are claiming to have invented.

[–] demonsword@lemmy.world 0 points 10 months ago* (last edited 10 months ago) (1 children)

Andrej Karpathy endorses Apple Intelligence

Who is this guy and why his opinion should mean anything to me?

EDIT: nevermind, searched for it and its some guy who used to work at OpenAI.

[–] xylogx@lemmy.world 1 points 6 days ago

He has some really good, in-depth youtube explainer videos on LLMs. That said this bit on Apple Intelligence does not seem to reflect what people are experiencing.