817 points by freddykruger 5 days ago | 295 comments | View on ycombinator
aiisahik 4 days ago |
ersshh 5 days ago |
How did none of this come up during diligence? Feels like a prime example of too good to be true.
halamadrid 5 days ago |
I would have expected this to be somewhere at the top right now given how deep the article digs and evidence seems legit.
OsrsNeedsf2P 4 days ago |
> Conclusions present before customer signs or provides info
If false, the defamation damages here would be in the tens of millions. Huge respect to whoever stuck their neck out to post this.
rooftopzen 4 days ago |
Should we worry about AI startup customer data…
tremarley 4 days ago |
suriya-ganesh 4 days ago |
intermediaries like delve have only amplified this failure.
it was obvious to anyone who was involved in this industry that, all of this is just security theatre with nothing really to back it up.
alanning 4 days ago |
hintymad 4 days ago |
Muromec 4 days ago |
amanhij 3 days ago |
bob1029 4 days ago |
AWS is probably the best actual CaaS vendor out there. They have a product offering expressly designed to help their customers get through this jungle:
https://docs.aws.amazon.com/artifact/latest/ug/what-is-aws-a...
You are still responsible for everything on top of what AWS provides (software/configuration/policy), but their compliance package handles a massive portion of what you would otherwise have to do if you were on-prem. Physical security, hardware management, disaster recovery, et. al., you get essentially "for free".
fareesh 4 days ago |
You build something great and big corporation X wants to buy a subscription but you need to be certified.
Much of this is a good checklist but some of it is very european.
"Where is the risk register to track controls in your 7 person company?"
Now instead of doing what your team does best, you are doing paperwork theater for frameworks designed for a 100,000 employee enterprise.
You are documenting things nobody will read, making up processes that don't exist and translating the operations of a lean company into bureaucratic language.
What's needed is a variant of these standards for small teams, which is proportionate and pragmatic.
stringtoint 4 days ago |
We were actually looking at it as well recently (we're using Drata). I was thinking "Cool, this looks like the next cool step forward". The claims didn't sound out of the world in my ears.
Every time an issue like this appears I wonder how many more undiscovered frauds are out there.
throwaway290 3 days ago |
Guys guys, if only it had some of that real AI it would be all good!!
flerovium about 4 hours ago |
sebmellen 4 days ago |
> We have prepared the accompanying description of Cluely, Inc., system titled "Cluely is a desktop AI assistant to give you answers in real-time, when you need it." throughout the period June 27, 2025 - September 27, 2025(description), based on the criteria set forth in the Description Criteria DC Section 200 2018 Description Criteria for a Description of a Service Organization’s System in a SOC 2 Report (description criteria).
> The description is intended to provide users with information about the "Cluely is a desktop AI assistant to give you answers in real-time, when you need it." that may be useful when assessing the risks arising from interactions with Cluely, Inc. system, particularly information about the suitability of design and operating effectiveness of Cluely, Inc. controls to meet the criteria related to Security, Availability, Processing Integrity, Confidentiality and Privacy set forth in TSP Section 100, 2017 Trust Services Principles and Criteria for Security, Availability, Processing Integrity, Confidentiality and Privacy (applicable trust services criteria).
I mean, just re-read this sentence:
> The description is intended to provide users with information about the "Cluely is a desktop AI assistant to give you answers in real-time, when you need it." that may be useful
It makes no sense at all.
Someone implemented the code to automate this report mill, and didn't think to even smooth it out with an LLM! There was clear intent here.
To imagine that an auditor reviewed and stamped this as a coherent body of work beggars belief.
cwal37 4 days ago |
"The trouble starts when you look at the answers Delve’s AI provided. Based on what your Delve policies claim, the questionnaire AI answers questions stating you have an MDM, had a 200 hour pen-test performed, and do regular backup restoration simulations. Tens of questions are answered like that. Great, you just lied to your vendor but at least you have a good shot at landing the deal. So what did we do? We kept our mouths shut."
Pretty rotten stuff. I went from energy into the software startup world and as I've gotten further down that road and energy has become more and more of a hot field I've encountered a depressing increase in that "just do it to make a deal" ethos, but in critical infrastructure.
Like, no, former Apple PM who learned about an interconnection queue from ChatGPT last week, you are not going to fix the grid, and even moreso you can't "just do X and ask forgiveness later", not in electricity.
ManuelSuarez 5 days ago |
laidoffamazon 4 days ago |
AFF87 4 days ago |
LunaSea 3 days ago |
m1keil 3 days ago |
I hope that with LLMs, answering security questionnaires will be much less time consuming for companies and less would opt out to get a full blown SOC2 cert. But it will probably play the other way.
egorfine 4 days ago |
Thus providing compliance is really just paying someone to shift responsibility.
The regulator can ask whether you are compliant. You can present certificate from Delve or someone else and that's the end of it.
latchkey 4 days ago |
https://x.com/HotAisle/status/1946302651383329081
The whole thing is a racket.
whatinthenote 4 days ago |
Willfully paying for a service that offers SOC 2 reports at 1/5th the usual rate and delivers them in days instead of months and deluding themselves (and others) that it's a proper audit.
Taking cookie cutter policies/controls jamming it into your org without any awareness whatsoever. Acting surprised when employees complain about draconian rules and the audit process is a pain because you wanted to take the shortcut.
Why can't people just do it the proper way the first time? Pay for a reputable auditing firm, write your own policies and implement controls that map to the actual organization, do a gap assessment with the auditing firm so that both parties is aligned on expectations, and spend the necessary time to undergo the audit. Getting it should be a milestone if you actually take it seriously and have a modicum of professionalism.
In my eyes, audits should be a trust exercise. You trust that your organization is organized in a way that meets standards (by doing the work) and the auditors trust that you aren't faking your evidence. As someone who has to regularly vet countless new software purchases, SOC 2 actually serves a role. Does anyone have a better idea of getting third party validation of how another company operates? Like sending them tons of questionnaires is the solution?
All this just breaks that trust by facilitating certification mills. Another example of fraud stemming from a country that churns out fake degrees, fake papers, fake conferences, and fake references.
chasewarren 2 days ago |
rvz 4 days ago |
What does that tell you about the scam that was unveiled?
Not good.
chromatin 4 days ago |
Forbes 30 under 30 remains undefeated
love2read 4 days ago |
throwaway2016a 4 days ago |
[1] No offense to MBA, just using it as a placeholder for: business stakeholder with no IT background.
jongjong 4 days ago |
The rookie mistake they made is they forgot to bribe the regulators with promises of future job offers.
ipython 4 days ago |
I'm sorry, but... $6,000 / 200 == $30 / hour? Just assuming the value of the actual certifications is $zero?
Wouldn't that raise some serious red flags?
fantasizr 4 days ago |
frankfrank13 4 days ago |
pkilgore 4 days ago |
stuckkeys 4 days ago |
dove-3746 4 days ago |
ohyoutravel 4 days ago |
debarshri 4 days ago |
gmerc 4 days ago |
llmslave 4 days ago |
But the tragedy is that there is a fixed pie of capital to be allocated, and so when they allocate to people like this, it steals opportunity from someone else
fnord77 4 days ago |
Never heard of any of them except Loveable.
upmind 4 days ago |
imaurer 4 days ago |
undefined 4 days ago |
claudiug 4 days ago |
LambdaComplex 4 days ago |
I hate that I've become this cynical, but it's gotten to the point where reading the "no x, no y, just z" construct makes me assume that writing is AI generated (and then I immediately stop caring about reading it)
frenchie4111 4 days ago |
moomoo11 4 days ago |
I guess it is great if you're a grifter/scammer or looking to just sell off to a FANG.
logaudit about 8 hours ago |
ninjav 2 days ago |
StacyRawls 3 days ago |
ryguz 4 days ago |
iam_circuit 4 days ago |
jefftrebben 4 days ago |
mchristophg 3 days ago |
undefined 4 days ago |
biggletiddies 4 days ago |
Cluely did the ChatGPT wrapper to cheat on interviews then sold the customer data to recruiters. The whole company promise is a scam, and useless since we have LLMs.
HockeyStack held contests for people to win cars etc and never delivered. They also lied about having revenues and a product when they had nothing built. Along with Greptile they were doing 7day weeks of unpaid labor from “trial periods”.
Scams all around.
advokatbard14 5 days ago |
aperture_hq 4 days ago |
rongupta 3 days ago |
ManuelSuarez 5 days ago |
faisal54 3 days ago |
mygooch 3 days ago |
mygooch 4 days ago |
gsibble 4 days ago |
clitheads 4 days ago |
gatreddi 3 days ago |
0xcady 3 days ago |
resiros 4 days ago |
> Two months ago, an email went out to a few hundred Delve clients informing them that Delve had leaked their audit reports, alongside other confidential information, through a Google spreadsheet that was publicly accessible.
Who leaked the audit reports? Who sent this email? Who is taking the time to write this analysis and kill the company?
In my opinion, the majority of the points in the article are no news. A compliance saas that offers templates for policies, all of them do. The AI is a chatbot, well who thought.
I think the main point is the collusion between delve and the auditors. Is the evidence for that clear?
They delivered the product that every company wanted - make the box checking faster.