Rabbit Gaslit Me, So I Dug Deeper (EARLY ACCESS)
Added 2024-05-22 23:33:21 +0000 UTCThis is part 2 of my investigation into Rabbit, where we take a turn to a more recent project that suffers similar problems to "GAMA".
Overhyped, underdelivering, I bought an R1 myself to go down the rabbit hole and figure out if a "new foundational model" was all it was cracked up to be.
It wasn't great. Jesse Lyu (CEO of Rabbit) denied an interview at multiple points, although the offer is still on the table.
Comments
I would have laughed so hard if rabbit had said “get your lazy ass up and make breakfast yourself”
Angie aka Mrs_Cuddelsworth
2024-05-31 02:42:19 +0000 UTCSo happy you remembered your password! 🧡
SeeBiscuit
2024-05-26 02:55:59 +0000 UTCTo be super honest though, a *lot* of startups start off like this. Get the basic thing working, prove the concept, then refine it. OpenAI itself was the same way — they trained their models on copyrighted data, aiming to produce “value,” with legal concerns being punted down the line. Rabbit is bad but not as blatantly fraudulent as those startups with fake users (and there are a lot). I think they need about 1 more year of development time before being close to doing what was advertised. And that also includes contractual negotiations with the API service providers (DoorDash, Uber, etc). The guy’s mistake was launching too early and calling it “production ready” when it should’ve been more like a very early access private beta.
Osman M
2024-05-25 07:04:06 +0000 UTCI was not even halfway through this and started wondering about security and data privacy. Is this company selling user information? I'd assume you'd need to login to all of your accounts on those apps which gives them a lot of information about the user. I could be incorrect about users being required to login to the apps.
Lil_Ellie
2024-05-24 18:04:50 +0000 UTCThe guy made such a smart move, just lie sell a plastic square with screen, profit.
Zero
2024-05-24 14:55:22 +0000 UTCYour eyes at "The DoorDash app is under maintenance" sent me, I am howling.
Chazzaroo
2024-05-24 12:09:12 +0000 UTCAwesome investigation. I wanted to ask you Coffee. In the world of entrepreneurship there is a term called Minimum Viable Product (MVP) which serves to understand the market, whether or not anybody will buy your product. Is it possible that the Rabbit is just a MVP and now that they have a proof-of-concept the real product can now be build?
Mithurshun Jeyatharan
2024-05-24 05:51:11 +0000 UTC"I'm not gonna answer your questions because the answers would be so technical you just wouldn't get it, bro."
Ross Vincent
2024-05-24 05:20:34 +0000 UTCItching for the next video….
Brandon
2024-05-23 22:52:50 +0000 UTCHow freaking stupid do u have to be to try and hoodwink coffezilla?!? History shows it never ends well…
Ant Wakefield
2024-05-23 22:09:05 +0000 UTCthe apron 💅
hazard_fox
2024-05-23 21:58:17 +0000 UTC2 years from now Coffee’s career will have completely pivoted from crypto related scams to AI ones.
Stephen Ford
2024-05-23 20:31:32 +0000 UTCScary how many psychopaths there are out there who say and do anything with no hesitation or shame just to make money. Thanks for making us all more aware Mr. Coffeezilla!
JBones RVA
2024-05-23 16:50:31 +0000 UTCI'm glad you reenacted the entire commercial of how Rabbit was demonstrated only to show how broken it is.
DaMu
2024-05-23 16:05:39 +0000 UTCI love the commercial remake! Great way to show the extent of the over-promises, and also your interactions with the rabbit are hysterical 😂
Elizabeth Woodley
2024-05-23 15:52:15 +0000 UTCReal talk even the term LAM is just a bastardization of the actual research term LLM for large language model. There’s no such thing as a large action model. I’m so done with these fools.
V L
2024-05-23 15:36:53 +0000 UTCIs the LAM in the room with us right now? 👀👀👀
V L
2024-05-23 15:35:57 +0000 UTCDid you look into the ties between Rabbit and Teenage engineering? Apparently it's also not a "coincidence", but shared board member(s)
Kilrah
2024-05-23 15:31:35 +0000 UTCI really have to wonder if what they are doing can fall into bypassing API limitations of these app companies for their product- I feel like they might not have consulted with these companies before pushing their product to store
/// _
2024-05-23 04:05:29 +0000 UTCAnother angle of theirs. Victim status. If we refuse to give you our side we can say you never gave our side. Scamological.
Brian Gibson
2024-05-23 04:03:08 +0000 UTCAwesome investigation, as always! A few things that I would like to mention, as someone reasonably familiar with this field: 1) Their claim that Rabbit is "faster than chat assistant apps like ChatGPT" might not be completely false, but it's a shady claim. OpenAI's API access to its GPT models, in many cases, *are* faster than the ChatGPT web app (accessed by non-developers). Of course, this doesn't change the fact that Rabbit is just a poor ChatGPT wrapper. 2) The concept of Rabbit's "Large Action Model" and Jesse Lyu's explanation of it is most likely inspired by WebArena (https://webarena.dev/), a benchmark to evaluate the web-browsing capabilities of LLMs. I attended a LLM agent workshop earlier this month, and the most recent results using GPT-4V (the state-of-the-art vision model) only achieved less than 30% accuracy on all the tasks. Keep in mind that those tasks (click through a few pages on a fake Amazon) are much simpler than the ones Rabbit claims to solve (booking Uber rides, ordering DoorDash, solving captchas, etc.). Knowing this alone, people should already be highly skeptical of Rabbit's "Large Action Model". 3) Theoretically, it makes sense to combine a tool like Playwright with a LLM to automate tasks. This is just like ChatGPT's function calling feature, e.g., it "browses the web" by invoking an external tool (that is not ChatGPT itself), which returns the webpage as a string, so that ChatGPT can process it. So, if Rabbit's "LAM", which is at best a finetuned/prompted vision LM that knows how to invoke external tools, can generate correct, *contextual* interaction instructions for Playwright, then Rabbit's claims may have some credibility (at least this is what academia is currently trying to achieve!). Note this is indeed different from Playwright's codegen, which generates static code that doesn't adopt to both the conversation context and the webpage's UI changes. But again, likely Jesse doesn't know what he's talking about, and Rabbit doesn't seem to have their own vision LM at all. 4) In the conclusion you mentioned Rabbit is "ChatGPT with an auto-clicker" - you are actually praising Rabbit too much! LLM researchers are trying very hard to make "ChatGPT with an auto-clicker" happen by improving LLM's web parsing capabilities :) Rabbit is more like "ChatGPT for answering questions, and Playwright scripts for using apps".
TigerHix
2024-05-23 03:17:20 +0000 UTCYour investigative work is great, but I'd love to see more analysis of the evidence in these cases and applicable laws to determine the (alleged) likelihood of legal liability. I know its not realistic to make every video a collab with someone like Legal Eagle, but I always feel like I'm left wondering what, if any, consequences the subjects of your investigations might face given the evidence you discover. Awesome content though! I've only ever subbed to a handful of Patreons, and yours is well worth it. =)
Hex
2024-05-23 02:34:28 +0000 UTCI was on the fence for this product until I saw the huge picture of a lock. I had no idea they took privacy so seriously. Respect!
Tamir
2024-05-23 02:09:32 +0000 UTCGood call: )
The Last Scientist
2024-05-23 01:54:09 +0000 UTCYeah I don’t think they’re very happy with me…, which is funny bc I bet no one tried harder to get their side of the story
Coffeezilla
2024-05-23 01:41:01 +0000 UTCWhen I was authorizing DoorDash and Uber, it looked like they initialized a virtual machine and had me remotely control and login on a window browser within that VM. Uber thought it was a spam IP I guess bc they subjected me to the most horrific captcha I’ve ever done
Coffeezilla
2024-05-23 01:40:31 +0000 UTCThe people who bought this are victims*
Harry Moore
2024-05-23 01:40:18 +0000 UTCI think it's easy for millenials. Like if you're over 35 you probably remember internet jumping to broadband pretty quickly (tho it already existed), the sudden jump to smart phones, and then the sudden jump to everyone being online.... and a lot of these things made the leap the moment someone made it cheaper. In the case of the smart phone it happened breakneck. For a lot of millenials not versed in tech and understanding the work put in behind the scenes, that had to feel like how tech just works. The Rabbit probably just felt to them like "someone figured out how to do it"
Harry Moore
2024-05-23 01:39:35 +0000 UTCYep. I spoke w some of those ppl. Wild. Rabbit tries to claim you need “rabbitOS” to justify why you can’t download an app.
Coffeezilla
2024-05-23 01:39:04 +0000 UTChopefully for their sake, no. I won’t be leaking it, it has really bad user privacy problems. I think someone leaked the android apk at some point but not sure if it’s public.
Coffeezilla
2024-05-23 01:37:37 +0000 UTCCoffee, I think you misunderstood the point of Patreon. Was said to collect our donos... you're out here collecting W's
Harry Moore
2024-05-23 01:36:13 +0000 UTCSo basically, you aren't going along with their marketing grift so that's not good. 😂 Sign of the times with most corporations these days.
Brian Gibson
2024-05-23 01:21:09 +0000 UTCMy hero ❤️
Jonathan Rivera
2024-05-23 01:18:37 +0000 UTCI’ll look into this
Coffeezilla
2024-05-23 01:17:37 +0000 UTCFantastic work coffee
Michael DeRoy
2024-05-23 01:16:59 +0000 UTCSame, love the aesthetic but if it was sorted in some way it’d be a lot easier to find yourself :)
Michael DeRoy
2024-05-23 01:16:02 +0000 UTCI don’t understand how anyone can watch that Rabbit R1 ad and think that they’re gonna an AI that is better than anything Google, Apple, and Samsung has developed at the low price of $200. A random Chinese company is somehow better than billion dollar tech companies trying to figure how to do this right now. Sure… The people who bought this are chumps…
Calvin
2024-05-23 01:03:06 +0000 UTCI am enjoying the shift away from crypto. Is the codebase for rabbit available on Github?
The Last Scientist
2024-05-23 00:43:16 +0000 UTCHype Coffee!! I’m really DIGGING this series so far :)
Eric Aidinovich
2024-05-23 00:21:32 +0000 UTCHell yeah! The more content, the merrier. And as someone who has been watching people call rabbit out over the past couple of weeks, this two-part series has been another incredible deep dive into an incredibly shady business. Phenomenal job man! Hope you're doing well man, excited to see all the projects you have in store.
Alexander Demers
2024-05-23 00:19:45 +0000 UTCA few people have gotten the Rabbit R1 to run on a standard Android phone. There could be some differences due to system permission issues. The Rabbit’s launcher app is installed as a root app. An Android install on a typical smart phone won’t get that permission. Still, the videos do show it doing many of the tasks as the official rabbit device — no LAM needed https://www.androidauthority.com/rabbit-r1-is-an-android-app-3438805/
David Weintraub
2024-05-23 00:12:09 +0000 UTCThey make users type login/password combinations and store them in their servers. I would be very curious to know what is the process they put in place to secure those passwords. Do they have one single encryption key for all users ?
Hamza H
2024-05-23 00:01:20 +0000 UTCIf I recall MKHB's review only the concept of the LAM excited him. If it doesn't exist, why have Rabbit!
Tinni
2024-05-22 23:55:55 +0000 UTCScam llam!
Nathan Mcwhorter
2024-05-22 23:42:07 +0000 UTCMan I was hooked on the first video, btw I still keep trying to find my name on the credits and no luck yet it’s like finding Waldo 🥲
Jonathan Rivera
2024-05-22 23:41:33 +0000 UTCPart 2 already. Sweet!
Dave McClintock
2024-05-22 23:39:34 +0000 UTC
