Hacker news

  • Top
  • New
  • Past
  • Ask
  • Show
  • Jobs

Salesforce Global Outage (https://status.salesforce.com)

280 points by mabil 4 days ago | 182 comments | View on ycombinator

stmw 4 days ago |

Despite all of the snark here, in my experience Salesforce SRE team is quite competent. The engineering challenges of running a large PaaS - not just with own apps, but with millions of customer-written apps running on it - are quite interesting, and sadly things happen. The status page makes sense to actual customers, it's the particular "pods" where a given service runs.

raffraffraff 4 days ago |

Have you tried turning it off and then on again?

> We're no longer pursuing restarts as a path to remediation.

Oh you have

mergy 4 days ago |

Unplanned outage timing is never good but this is really not good.

https://www.salesforce.com/dreamforce/

Sept 15-17

fhub 4 days ago |

Cause: Legacy Salesforce login service got into a resource-exhaustion cascade.

Fix: Rolling some unspecified fix they proved in testing out over the fleet seemingly very slowly (After their earlier attempts to roll something out faster failed).

Details at https://status.salesforce.com/incidents/20004433

cyberpunk 4 days ago |

That status page is the most salesforce thing ever.

Scroll down. >_<

electroweak 4 days ago |

At this point OpenAI really ought to let us know when they're testing again.

AmazingTurtle 4 days ago |

You better bet someone started their agents with a prompt "Make a salesforce clone but with 100% uptime"

chasd00 4 days ago |

You can click on any of the instances and then the service that is down to read the updates. It’s not 100% clear but some sort of issue with a “legacy login service”. The latest updates say a fix is rolling out.

adamw2k 4 days ago |

Perfect timing with Dreamforce this week.

arionmiles 4 days ago |

This is certainly a unique status page.

reddalo 4 days ago |

I can't understand how such a huge company can have such a lousy UX.

danjc 4 days ago |

It's dns isn't it

alienbaby 4 days ago |

Haven't they got some kind of new fancy ai interface they can use to fix it?

cmiles8 4 days ago |

Salesforce has turned into the monolithic messy bloatware it set out to replace.

Please VCs stop with the AI FOMO and find a few good startups to just go destroy Salesforce and give folks a simple inexpensive replacement.

ownerr 4 days ago |

Here is link to incident details: https://status.salesforce.com/incidents/20004433

ssk42 4 days ago |

My gut instinct is that this is about when all of their on prem servers were EOL and their /public cloud solution was required. This must have had something to do with that

bgro 4 days ago |

Leetcode developers win again

voidUpdate 4 days ago |

Wow, the intern must have tripped over a very big power cable this time

treebeard901 3 days ago |

All the prompt engineers clogging up San Francisco for dreamforce need to get back to the office.

themgt 4 days ago |

Never before in the history of global compute outages was so little lost by so many down servers, whose purpose was known to so few.

cmiles8 4 days ago |

Dreamforce, wake up. You’ve overslept!

sergiotapia 4 days ago |

RPC errors in my Dunkin app and my wife's Poshmark app. Is it an infrastructure problem?

zzzeek 4 days ago |

I'm sure the cause of this outage will not be connected to vibe coding in any way

mariopt 4 days ago |

Could it be people doing Claude/GPT automations and they just can't handle it?

sparkling 4 days ago |

Remind me please, what are folks currently paying per seat for this glorified CRUD app?

lrvick 4 days ago |

Seems it is back up now. Damn.

jason_zig 4 days ago |

I was just working on a zigpoll integration and thought it was me...

dboreham 4 days ago |

At least now we can figure out what Salesforce does.

sidcool 4 days ago |

ClaudeForce in action!

elzbardico 4 days ago |

Kind of ironic. Salesforce is basically one of the major spiritual grandfathers of Slop. It is not uncommon in production systems to find that objects like Contact and Account have hundreds of custom fields. Sometimes, you find out that several of them have the same meaning and semantics, but were used at different times. Digging out you discover that some Marketing guy that used to work at the company did some task in a certain way that was lost when he was gone, and then a few months later his substitute had the same need and went ahead and created the same field with a slightly different name.

Doing data engineering work with Salesforce data is an exercise on archeology, psychology and organizational politics.

Slop is basically the ontological and teleological philosophy behind Salesforce very existence. Despite the official discourse that the "No Software" meant no infrastructure, no toil with updates and configuration, the subtext as intended for executives was very clear: "No need for you to be blocked by those pricks from engineering and their stupid, bureaucratic and gatekeeping rules".

"No software" was a call-to-arms to a certain subset of managers that were radicalized by Nicholas Carr's 2023 HBR article "IT Doesn't matter". It doesn't matter that Carr was a journalist and a writer with a masters in English that has never ever run even a small bodega, or has never managed an IT department. Anti-intellectualism and the abundance of capital brought in by the petrodollar that allowed the US government to run deficits year by year while exporting the ensuing inflationary effects to rest of world, would ensure that this message would ressonate and then even be amplified during the years of ZIRP and the Baillouts. Play fast and loose, first come, first served, a rising tide rises all boats and all that jazz. Wall Street favors bold, and the heck with the long term! This quarter will only live once!

Frankly, this is just poetic justice: Kill by slop, be killed by slop.

Havoc 4 days ago |

So I guess today everyone gets actual work done

theshrike79 4 days ago |

Was it DNS? Any guesses? :)

jtrn 4 days ago |

And nothing of value was lost. God, I hate everything about Salesforce. Sometimes I have to integrate against their services, and it is always a pain, not to mention what the core project actually is: optimization of marketing and spam.

jackdecker 4 days ago |

Ah yes. Exactly what a status page should look like: an endless list of random ID’s that don’t mean anything and no information whatsoever

At least salesforce is consistent with their design language

aeneas_ory 4 days ago |

It’s akways DNS or login

wronex 4 days ago |

Does it mean I won’t get any AI generated slop spam for a few hours?

dogas 4 days ago |

danvesma 4 days ago |

"Trust just got personal!"

justplay 4 days ago |

[dead]

haemdahl 4 days ago |

[dead]

irregularbowels 4 days ago |

[dead]

WhenItRuns 4 days ago |

[flagged]

sick_of_slop 4 days ago |

[dead]

fr2029 4 days ago |

[dead]

gjvc 4 days ago |

[flagged]

imagetic 4 days ago |

[flagged]

monkeydust 4 days ago |

[flagged]

mannycalavera42 4 days ago |

[flagged]