Yeah, we did the national there and it was a lot of fun. One trail we went on our guide sort of downplayed how hard the trail was and I think some of us were beyond where we wanted to be (me, considering I had to drive back to MI). I didn't have any issue, but we has some real fun on that ride
I think there's tons out there you can do reasonably in the Scrambler though, that was just our guide IMO.
I think you'd need to decide if the stress of having to drive home (I am assuming from the way you said it) is worth it. As someone who basically ALWAYS has to drive home, it's both a thrill and stress to know that you've got deal with whatever goes wrong to get back.
Personally, if this were a family vacation, I'd go the SXS route for the sake of knowing you're good no matter what.