Monday, July 01, 2019

The Lack Of A Posting This Morning

     Awake at six a.m.?  Check.  Cats fed?  Check.  Not ill?  Check.  Slept?

     ...Um.  Not so much.

     Along about dinner time last night, I had a call from work.

     "Along about dinner" being that point in the process where I had two New York strip steaks and a batch of mushrooms in a cast-iron grill pan on the stove, having decided it was too hot to grill outdoors.  My right knee was hurting and while I hadn't quite been in pajamas all day, what I was wearing wasn't suited to anything more formal than weeding a garden, and maybe not even that.

     Dinner was at that point where you either finish cooking it and eat it, or you throw it away. Dinner for two.

     So the phone rings and it's one of the Master Control techs, reporting a pressurization issue at the unstaffed North Campus.  We monitor a couple of things up there that are kept dry by keeping them full of dry air (from a sophisticated compressor-dehydrator*) or, as a backup, dry nitrogen from tall, 3500-psi tanks of the gas.  The system only runs 5 psi above ambient, but it's a critical 5 psi; what we're keeping dry runs a thousand feet, carrying high voltage, high-current VHF and UHF energy and if it gets wet, the connection points (one every twenty feet) can begin to arc and heat up, melting their support insulators.  This doesn't end well.

     Dry air is fed into the system from a single point but there are two different monitors.  I am rewiring alarm connections, and one of them failed shortly after my last work.  It had been intermittent; I thought I had found the wiring problem but I had not.  Hey, no problem, we have two alarm sensors; I asked Master Control be especially vigilant until I could return to the North Campus.

     And that was why the tech had called: the second alarm had tripped. 

     Maybe it was a false indication, maybe not.  There's a while left once the alarm goes, at 2.75 psi.  Nothing for it but to finish cooking, eat dinner in some haste, change into slightly more civilized attire (it's always 65°F at the North Campus, unless something has gone very wrong), grab a few bottles of water, and head out.

*  *  *

     Arrive to discover the compressor was dead.  D-E-A-D, no breakers tripped, motor windings reading less than half the normal DC resistance. 

     System pressure was just under 2 psi.  I started up the dry-nitrogen system and the regulator was wonky: the tank was low.  I set flow rate with the valve so it was sitting at 3.5 psi to repressurize, loaded all one-hundred and fifty pounds of the compressor-dehydrator onto a cart, and hauled it to the the workshop in the far end of the building.

     A few more checks later, it was obvious there was no fixing the compressor this side of an electric-motor shop.  I have a spare, of course.  It's tricky to change; you can't get at the mounting bolts, so you remove the support plate from the shockmounts.  The plate is held by bolts through the rubber shockmounts from underneath and, you guessed it, they won't support the 60-some pounds of the thing  upside down or sideways and the feet of the unit aren't tall enough to let you reach under.  Nope, one hangs the enclosure over the edge of the cart and removes one bolt at a time.  A bit of un-plumbing, some electrical, and it was out.  The same thing in reverse to install the replacement (after a spine-freezing moment when I read "230V/50Hz" at the top of the label on it, until I read on down to the description of how to strap it for 120V and the maker's admission that it would run on 60-cycle power, too).  Checked it was set up for wall-socket juice and proceeded to test the finished installation.  This is quick to write but it's nearly two hour's work.

     It ran fine!

     Hauled it back to the far end of the building, plugged it in, and started it up without connecting the output.  The compressor feeds a finned cooling section and then a pair of "molecular sieves" that remove the last bit of moisture from the air.  There's a clever arrangement of valves, one of them run by a solenoid controlled by a thirty-second timer: every half a minute, one of the sieves gets backflushed to clear any captured moisture, while the other is online.  Thirty seconds later, they trade places.  If the thing has been shut down, you need to run it to clear them both out, a process that can take up to an hour.

     The dry air is held in a small tank at about 70 psi, and fed out through a regulator at 2 to 10 psi, so the compressor can run at a reasonable pressure and comfortable duty cycle, and so there's sufficient pressure for the backflush.  Drying it out, all you need to do is let it spill air into the room and make sure compressor run time isn't excessive.   --For an hour or more.  There's a nice front-panel light to show when it's making dry air again.

     I passed the time checking nitrogen pressure and flow, and pondering if I was too sleepy to change out a big tank if necessary.  Cleaned up the shop, puttered around at this and that, and an hour later--

     An hour and a half later, there was still a big "Humidity Alarm" light.  It hadn't sneezed any water out the drain line, either.  And the more I listened, the more that solenoid valve cycling sounded just a little wrong.

     Replacement valves are amazingly expensive.  Rebuild kits for them aren't and I keep a couple on hand whenever the budget permits.  (Okay, I admit it: I sneaked the second one in years ago.  There are a lot of fiddly little bits to replace and "Two is one and one is none," if one of the pieces goes missing!)

     Unplugged the compressor-dehydrator and horsed it back onto the cart, all 175 pounds of it.  Back to the shop, cover off, the valve is buried deep in the guts of the thing but I have been at it before; there's a trick to it.

     Two of the air connections are "prestolock" types and there's no removing them in situ, period.  Out of situ, maybe, but it's not worth it.  The drain line is nothing, just a short section of flexible tubing that pokes through the back panel. The fourth connection is a section of flexible line I replaced a decade ago, softer line connected with a hose clamp and barb.  That, you remove with a razor blade, and lose a short section every time.†

     The valve is tucked into a tiny gap in the middle of air line, wiring, tanks, molecular sieves, the compressor and sundry ancillary items.  You can unbolt it from the back panel, then wriggle it up far enough to remove the solenoid coil (thank you, ASCO "Red Hat" design!), set that to one side. thread the drain line out, cut the input line at the barb, and move it out and rotate the assembly so you can get at the four 1/4"-20 bolts that hold the two halves of the valve together.  There's barely room to get a wrench on them and they're snugged down tight, but it is possible to take it apart.

     That gives you one half still plumbed into the machine, with one dual valve seat and four O-rings on it; and another half with the four-part solenoid plunger assembly -- no, make that five parts -- a complex double-ended commutating inner valve, a single valve seat and two more O-rings.  Except for the threaded outer solenoid tube (got your 1" box wrench handy?), it's all force-fit and stuck together with a couple of years worth of gloop.

     Take everything apart, clean it with alcohol, dry, lube the O-rings with silicone grease and the valve seats with a tiny dab of molybdenum disulfide in silicone, keeping any excess away from the rest of the valve.  The solenoid plunger has a key that engages the commuting valve, and an internal spring and brass tube that complicates the task.  The other end gets rebuilt in place; the seat is very tight and has to be prised out with tiny screwdrivers, and the far side takes a pair of tiny O-rings that you'd never find if they hit the floor and rolled away.

     (It was at this point that I noticed my right knee wasn't taking weight very well.  Oh, well, the job still has to be done.)

     The two halves get mated up and awkwardly bolted tight, it's moved close to position and the coil assembly is slid back on, and a new retaining clip is installed.

     New retaining clip-- Rats, I'd left it on the workbench.

     Left it, in fact, right next to a short coil spring that goes inside the body of the valve, around the solenoid plunger right where it engages the commutating inner valve.  You know, the thing that's not all that easy to put in even when you follow the correct procedure.
The solenoid plunger tube sticking out of the valve body and the spring that's supposed to be inside the brass part.

     Nothing for it but the valve's got to come back apart.  That takes time but eventually the big half is back on the bench.  Rather than unscrew the plunger tube and risk tearing up the O-ring, I used thin needlenose pliers to hold the plunger as I slid the commutating part out, put the spring on, and slid the inner valve back in place.  It only took three tries to get everything all lined up.

     Next, reassembly, with all the fun that entails, and by then I was getting a little punchy, having to slow down and check myself at every step.

     Got it all back together, tightening down the last hose clamp, plugged it in and hit the switch.  The compressor started up, gauges fluttered up the scale and thirty seconds later, the drain line sneezed out a couple of tablespoonfuls of dirty water as one of the molecular sieves ran its first purge cycle.

     I put the outer cover back on, hauled it back to the far end of the building, wrestled all 200 pounds of the thing off the cart, plugged it in and started it.  An hour and a half later, the "Humidity Alarm" light went out for good (after a half hour of off again/on again: one sieve was a lot wetter than the other) and I reconnected it, shut the dry-nitrogen valves at tank and manifold, then watched, adjusted, waited and adjusted again to get the system back to normal pressure.

     I limped around putting tools away while getting it all stabilized and finally left after another hour. Total time from arrival to departure, eight hours.  On no sleep.  My knee was hurting bad enough to make up for it, at least.

     Driving back home just ahead of sunrise was, well, "interesting."  I texted my boss, ate a snack and took ibuprofen, and made it to the bed right before I fell soundly asleep.

     That's why there wasn't a post this morning.
* You can think of it as being like the thing in your garage you use to air up tires and maybe operate small tools, but it's not.  The compressor itself and its motor is a single unit the size of a sewing machine and twice the weight; the output is cooled, regulated and run through a "molecular sieve" to remove any trace of moisture.  The whole assembly is about the size of three sewing machines. They cost about what I usually pay when I buy a used car.

† There are various barb designs and some of them purport to be more removable than others.  In my experience, after a year or more of being compressed, the hose cannot be removed by anyone of normal strength.  YMMV.


BC said...

Really like the technical post especially with pics! Even when it's a pain in the backside it sure is nice to be able to say "I fixed that" at the end of the day(s) sometimes.

Will said...

If space permits, try to push that hose off the barb, instead of pulling it. Consider modifying pliers to slip behind the end of the hose to enable this without touching the barb shaft. I have a pair that has the tips formed in a circular shape, and this helps apply a more equal force to the hose end if I can get behind it, or if I am forced to grab the hose near the end to move it. This design also helps grabbing the hose to rotate it to break it loose before removal.

Hose tends to act like those Chinese finger cuffs that compress when you try to pull them off. Some more so than others the same size, so you might want to look at a replacement hose that has a stiffer construction and/or thicker wall to fight this.

Hopefully this doesn't come across as a "grandmother and egg-sucking" comment. Caution, Aspie in action!

JimBob said...

Good thing you didn't have to move it again! Would've weighed 300 pounds!!!

Roberta X said...

Will, that method will usually work with the kind of barb that has a single smooth bulge near the end, but this one is a "sawtooth" barb, with four annular ratchet-type steps, and once that tubing goes on and has been clamped down, it's not coming off, even with the hose clamp removed. BTDT and it's quicker to slice it.

Roberta X said...

JimBob: thanks for seeing my joke!

JayNola said...

Sounds like a fine bit of starship engineer mechanic-ing. Bravo for getting'er done.

Merle said...

Your life sure isn't boring!!! :)

pigpen51 said...

I worked in a steel melt shop, making metals for sale to the investment cast industry for over 35 years. One type of furnace we had was vacuum furnaces. They were able to get below 8 microns of pressure. But we had to keep our pumping system in top notch shape.
We had valves of several types. One was a simple butterfly valve, with a simple flapper inside which actuated by simply turning and sealing up with a rubber o-ring. They worked quite well, but we only got them in the last few years I worked there. Our other valves had long rectangle bodies, with two round plates in them, which were offset to each other. Much like the toggle link in a 1911, when a pneumatic piston pushed on the valve, it forced them both forward, and upon striking the back end of the box, the links, 4 of them, would force the movable half of the round valves up, locking into the stationary portion of the pipe that was part of the pumping system, and sealing the valve.
There were times when we had to introduce Argon into the tank, in order to protect the bath and keep any leak from introducing O2 or N 2 into the bath, thus contaminating the alloy. The reason for melting under a vacuum was to avoid undesirable trace, or tramp, elements. Oxygen and Nitrogen were both undesired elements. We made alloy for companies that made engines for jet aircraft, such Rolls Royce, Pratt and Whitney, General Electric, and others. And also a lot of high end metal for things other than internal, hot parts of jet engines, like blades. We also melted under a vacuum for Rolls Royce for their turbo parts, as well as for a few other automotive companies.
Our metal went into the stainless steel exhaust systems on higher end vehicles. That type of steel is only an alloy called 409, which is basically a 410, with slightly different chemistry. 400 series alloys are only Fe, Iron, and Chrome, with carbon, manganese, and silicon, which contributes to their castability. If you add nickel, you make it into a 304. If you add sulfur to 410, you have basically got a 416S. The sulfur makes it easier to machine it, with the long strands breaking up into chips.
The 304, if you add Molybdenum, you get 316, sometimes they add sulfur to both of the 300 series alloys. Those alloys are used in heavy corrosion applications. Boat propellers are mostly made of 316 with Sulfur, while gun barrels are made with either 410 or 416, plus both of the various product can be made with what is called precipitating hardening steels. Those are 15-5 and 17-4. Both of those are close together, as far as chemistry, as both contain columbian and copper, as well as chrome and nickel. The columbium and copper allow for greater acceptance of heat treatability.
I might have said this here, but one time, we got several hundred thousand pounds, packed in heavy gaylord boxes, of Mexican pesos, that had been discontinued. Representatives from Mexico came to watch us melt them to ensure that we did not steal any and make them into their circulation once again.
I think that the strangest thing I ever saw come into the shop for remelt is a tie. We got back a bunch of tail fins for the sidewinder missile. And we also got some of the molds that they use to make the Mickey Mouse balloons for Disney World, or Land. They just dipped them upside down into the latex, and run it down the line until it dries, and since they had a hole in the side, running up to the center, I guess to help blow them away from the mold.

waepnedmann said...

No one is irreplaceable...until they are.
I hope this will earn you some deserved recognition.
Preferably in the form of a bonus.
Nothing says, "Thank you and atta-girl!" like a couple of hundred dollars bills and a gift card to a nice restaurant.

Roberta X said...

My bonus was being able to take the rest of the day off. This is quite literally what they pay me to do. I make a little more than the other techs because I do these kinds of things.

Rick T said...

I hope they are looking for an apprentice or two for you for a bunch of reasons...
- moving gear that size solo
- so much tribal knowledge between your ears
- being in a remote site solo...

Great job and great story..