重いの would be "heavy one", as in 重いのをください ("please give me the heavy one."). You don't need が or は at all, unless the heavy one is the subject or topic. If you say "that's the heavy one," then yes, I'd say you would use が -- あれ/それが重いのだ(よ). の here is a pronoun, like "one" in English.