You're a wuss, Ross.  I've done plenty of X Country ski jaunts, even in below zero, and you don't need to peel off multiple layers to pee in the woods, and nobody should be going #2 very frequently.  The ladies have a little more inconvenience, but still it shouldn't be a reason not to X country ski, since the benefits of this sport far outweigh stuff like that.  Also, you shouldn't be wearing "multiple layers" until you stop skiing.  I use a polypro type ski suit, since I'm usually overheated, if anything after skiing just a few minutes (I never wear a heavy ski jacket)..which is one of the beautiful things about the sport.  No matter what temp, just good, even thin insulating materials will keep you toasty warm while skiing.  The most important items are a good hat and gloves. 

And, I agree entirely with Andrea.  I've even done overnight ski camping trips.  With good down sleeping bags it is doable.   On day trips, I've stopped, lit a fire or used a stove, made hot chocolate or coffee.  The beauty and tranquility of the woods, especially where you don't see too many other people, or even better, any other people, cannot be matched.  I remember a trip I did with a classmate decades ago (everything with me is a long time ago), where we skiied on the coldest weekend in February up in Northern Quebec. After a few minutes we were warm and comfortable, and it was amazing, skiing over  frozen lakes. At night when we camped, we did freeze our asses off even with good gear, but the daytime skiing and food preparation was never a problem. 

And remember, no chair lift=no lift lines!!

I'm a big fan of the late, great "Jackrabbit" Johannsen.  When he was about 90, he came to our summer camp and talked to us about the outdoors.  He really looked askew at Downhill skiing...even then, which was mid-60's.  One comment of his, I still remember.   He said something in reference to Downhill skiing like, why do people pay so much money just to "stand in a line".  Once, when asked about what type of wax he would use, he said, "Wax, shmax, just put on your skis and ski", or something like that.  He was a ski legend in his day, a true pioneer. 

http://laurentian.quebecheritageweb.com/article_details.aspx?articleId=82