main
Cygnus XL Hit Reset In Orbit, And The Bug Was Us
Cygnus XL tried the classic IT fix in reverse. It turned itself off and back on again, except the off part happened mid course tweak and twice, which is not the vibe you want when your grocery run is…
By Doc ·
Cygnus XL tried the classic IT fix in reverse. It turned itself off and back on again, except the off part happened mid course tweak and twice, which is not the vibe you want when your grocery run is doing 17,500 miles an hour. The gag writes itself, but the bruise lands on code, not hardware. The engine did exactly what it was told, which is both reassuring and a little horrifying, because who among us has not coded ourselves into a corner and then pretended it was a design choice. We all have that friend who bails at the first weird noise from the car, this one just has hypergolic breath.
Why care. Because modern spaceflight is less hot metal and more finicky logic, and your margins live in the math now. One conservative bit can push a whole week sideways. A less conservative bit can turn sideways into shrapnel. That is the game. Not bravado, parameters. Not torque wrenches, timing tables. The rocket stuff is still heroic, sure, but the quiet victory is when your fault management trips for the right reasons, at the right time, after ten thousand test cases that did not make it into the YouTube montage. Think of it like plumbing in a high rise, invisible when it works, spectacular when one valve sneezes and the lobby gets a shower. Software is the pressure regulator, and it better know the building it is in.
And this was a first of kind stretch job. Cygnus XL is longer, roomier, heavier in the ways mass properties get weird, and first flights always teach you what the spreadsheets smoothed out. Change the body, you retune the instincts, then you unlearn them again when the real vehicle shows its quirks, because the vacuum does not care about your Monte Carlo plots. Protection thresholds, guidance timing, fault logic, all of it. Guidance retuning is like swapping a violin string on a chainsaw, it sounds ridiculous until you remember both are oscillators and one bad frequency makes a mess. If you do not retune, software sees a normal wiggle and calls it a swan dive. That is not an engine problem, that is systems engineering sending itself back to study hall. Which is fine, study hall saves lives, but it will also make you late for class now and then.
Follow the money with a clothespin on your nose. Resupply is a tidy business with public risk and private invoices. SpaceX gets paid to loft. Northrop gets paid to build and fly. NASA eats the angry calls when Tuesday becomes Thursday. A one day slip does not crater a quarter, but it does land on people. Astronauts shuffle maintenance. Flight controllers stretch a shift. The patch team earns their café. Then it gets buried under programmatic margin, which is bureaucrat for we will pay later and we will not notice when. Start doing that by habit and schedules begin training the software like a dog that only sits when guests arrive. Actual fixes look different from schedule theater, you fund the slow work up front or you pay interest in orbit. Safety first is not a slogan, it is a budget line and a habit you protect when the Gantt chart glares.
Meanwhile, this crate was full of not optional. Food, oxygen, nitrogen, spares for the pee machine, an external navigation aid so future vehicles can show up without as many hands on the stick. Plus labs in boxes, growing better semiconductor crystals, and teaching cryogenic propellants how not to throw tantrums over long trips. Esoteric, until you remember deep space is one long cold road trip and you do not get to stop for gas. Keep the fuel calm for months, or enjoy your scenic tour of nowhere. The station runs on groceries and experiments, not vibes.
The fun part, which is not fun, is that patches are logistics now. Uplinked limits saved a half billion dollar supply chain from a domino week. That is the good news. The warning label is that we are normalizing the idea that fix it live is part of the plan. It is, but it should be the exception, not the jam session. Every time you tweak in flight, you prove the system works and you also tempt fate. Cautious bits delay dockings. Bold bits leave souvenirs in orbit. Pick your poison, then test the antidote like your rent depends on it, because it does. Ground control had grounds to intervene, but that joke should stay a one sip special, merci.
Cygnus will do the honest work. Six months parked, trash collected, controlled reentry, clean burn over the Pacific. A dignified end for a flying dumpster with a heart of gold. The lesson sticks around longer than the hardware. Engines can be flawless and the real risks sit in the code, and the code answers to people who answer to calendars. That is the tension. That is the job. And yes, we can handle it, if we keep treating software like plumbing and not poetry.
So what actually happened. During a routine midcourse burn, fault logic in the new XL configuration saw transient readings it did not like, likely tied to the stretched vehicle’s different mass and vibration profile, and it commanded an engine shutdown, twice. The engine was fine. It obeyed. Autonomy then did the other classic IT move, it reset and restarted, but each time the limits were still too tight, so it bailed again. The team widened thresholds, adjusted timing for the guidance loop, and reenabled the burn with an uplinked patch. That bought a day, not a disaster. The next burns behaved, the cargo kept flying, and the lesson is exactly what it sounds like, teach the software the new body or it will treat normal wiggles like cliff dives, and then it will pass that final at 3 a.m., parce que bien sûr.
--Doc (yeah I said it!)
find me anywhere under @DocAtCDI
Tags: Spaceflight, Software Engineering, ISS Logistics, Risk Management, Public–Private Space Contracts
https://thesixthlense.com/article/cygnus-xl-hit-reset-in-orbit-and-the-bug-was-us · The Sixth Lense