The fuel tank has to come out but it's fairly easy to do. Hopefully the tank isn't too full. The fuel pump assembly is kind of expensive, like $300ish or more plus you'll need to change the fuel filter (likely the cause of the pump failure).
One bolt on rear fuel tank strap, 4 nuts on front tank bracket on outside of frame, unbolt rear driveshaft from rear diff, loosen hose clamps on fuel filler and vent hoses, unbolt tank electrical connector/ground wire and it's ready to come out. You'll need a special tool to remove the fuel lines from the pump but is readily available at most part stores. Make sure to only use a Delphi pump assembly or you'll be doing it again soon if the part isn't DOA.