that is using Crowdstrike on their Windows machines are in for a very long weekend. So far only manual workarounds are available and it means touching every single machine
Just got into work and was hoping I may be included
had some problems early this morning. That seems to be resolved now.
My wife's work from home laptop is fucked up by the update and she's going to be in a long list of folks who will need a hands on fix.
As a guy who manages teams that host software for folks, we work really hard to avoid days like this one for CrowdStrike folks. Stock down 12% over this right now.
and may cost them future business. I bet some of their customers will start thinking about using a competitor. You can't bring down a customer like Microsoft without consequences.
and may cost them future business. I bet some of their customers will start thinking about using a competitor. You can't bring down a customer like Microsoft without consequences.
How long until the CEO (Kurtz) gets canned? He was on the Today Show apologizing this morning. And their stock took a hit, as would be expected.
had some problems early this morning. That seems to be resolved now.
My wife's work from home laptop is fucked up by the update and she's going to be in a long list of folks who will need a hands on fix.
As a guy who manages teams that host software for folks, we work really hard to avoid days like this one for CrowdStrike folks. Stock down 12% over this right now.
M365 was down yesterday and over night as well. Apparently, MS uses Crowdstrike to deploy their own updates?
35 years ago this wouldn't have caused this large a problem
we are way too reliant on computers for every single thing in our lives and it could all get wiped out with a keystroke. It doesn't keep me up at night but I wonder if it should.
had some problems early this morning. That seems to be resolved now.
My wife's work from home laptop is fucked up by the update and she's going to be in a long list of folks who will need a hands on fix.
As a guy who manages teams that host software for folks, we work really hard to avoid days like this one for CrowdStrike folks. Stock down 12% over this right now.
M365 was down yesterday and over night as well. Apparently, MS uses Crowdstrike to deploy their own updates?
Yeah, I guess some azure resources have crowdstrike and were affected too. The fix is actually pretty easy and small, it seems, but you need to touch each affected machine. That makes stuff in data centers easier to fix than PCs at home for remote employees.
A small one, I only have around 700 windows crowdstrike endpoints that crashed. I've been up since 2:30 working with our response team. We got all our stuff back up by 7am. We provide 24x7 business process and professional services in constant use.
Can you imagine (though I have to think this is all automated, but still, imagine if) you are some devops person who compiled and deployed a routine update, and today the president is being briefed on your f-up, governments are calling emergency meetings, your company lost, what like 12% of its value, and literally the global economy has been harmed...
But am NOT an IT expert. Without knowing the absolute specifics, this appears to be a bug in a patch that was released at midnight. That sounds to me like someone didn't sufficiently test their code. You have a QA (test) environment where all has to be perfect before you roll out to production. Especially a company who's software reaches around the world.
That said, it sounds like a plain ole mistake. Best laid plans and all. We had something like this happen internally several yrs ago, it massively effect my company but us alone. A manager and two contractors were fired for insufficient testing. These things happen but at a Crowd Strike the stakes are so much higher.
For those who think the CEO will get fired, nope. He is seen as one of the best in the business and has turned them into a multi-billion dollar company, and industry leader. On CNBC they were already saying this morning's huge drop in the stock is a buying opportunity.
Oh and for the we rely too much on computers crowd, did you just wake up from 1982?
I see a couple people mentioning they work in IT/Software development.
I was laid off a few months ago and looking for a position as Software Configuration Manager/DevOps Manager/Project Manager. I have 20+ years experience in software development. Looking for a fully remote or hybrid position. Any leads would be appreciated. Thanks
My wife and I were on our plane from Atlanta to Newark when they…
we were deplaning because they had nobody to fly the plane. Pilots never made it from previously canceled flights. Major shitshow. Hundreds of people sleeping everywhere in the airport, thousands of pieces of luggage everywhere. Somewhere among those thousands of pieces of luggage is ours. Will try to locate ours by going back to the airport today. Awful, but at least we could go home after our plans were ruined. So many people just stuck for many long hours at the airport.
My wife's work from home laptop is fucked up by the update and she's going to be in a long list of folks who will need a hands on fix.
As a guy who manages teams that host software for folks, we work really hard to avoid days like this one for CrowdStrike folks. Stock down 12% over this right now.
How long until the CEO (Kurtz) gets canned? He was on the Today Show apologizing this morning. And their stock took a hit, as would be expected.
My wife left banking at the end of 2022. She's very happy about that fact today
My wife's work from home laptop is fucked up by the update and she's going to be in a long list of folks who will need a hands on fix.
As a guy who manages teams that host software for folks, we work really hard to avoid days like this one for CrowdStrike folks. Stock down 12% over this right now.
M365 was down yesterday and over night as well. Apparently, MS uses Crowdstrike to deploy their own updates?
Same.
Quote:
had some problems early this morning. That seems to be resolved now.
My wife's work from home laptop is fucked up by the update and she's going to be in a long list of folks who will need a hands on fix.
As a guy who manages teams that host software for folks, we work really hard to avoid days like this one for CrowdStrike folks. Stock down 12% over this right now.
M365 was down yesterday and over night as well. Apparently, MS uses Crowdstrike to deploy their own updates?
Yeah, I guess some azure resources have crowdstrike and were affected too. The fix is actually pretty easy and small, it seems, but you need to touch each affected machine. That makes stuff in data centers easier to fix than PCs at home for remote employees.
And all his End Users are taking it in the End.
Can you imagine (though I have to think this is all automated, but still, imagine if) you are some devops person who compiled and deployed a routine update, and today the president is being briefed on your f-up, governments are calling emergency meetings, your company lost, what like 12% of its value, and literally the global economy has been harmed...
That is a very bad day at work.
That said, it sounds like a plain ole mistake. Best laid plans and all. We had something like this happen internally several yrs ago, it massively effect my company but us alone. A manager and two contractors were fired for insufficient testing. These things happen but at a Crowd Strike the stakes are so much higher.
For those who think the CEO will get fired, nope. He is seen as one of the best in the business and has turned them into a multi-billion dollar company, and industry leader. On CNBC they were already saying this morning's huge drop in the stock is a buying opportunity.
Oh and for the we rely too much on computers crowd, did you just wake up from 1982?
MS literally said try that, up to 15 times. We did :) it didn't help. Safe mode to the rescue, assuming you can even get to a console session.
Luckily we did, or I'd still be in Orlando right now.
I was laid off a few months ago and looking for a position as Software Configuration Manager/DevOps Manager/Project Manager. I have 20+ years experience in software development. Looking for a fully remote or hybrid position. Any leads would be appreciated. Thanks