If you bet 20.. then he raised to 80.. that should have been a sign that if you called or raised, that you had him beat... since you went all in , he should have at bare minimum put you on AT LEAST a pair of nines (let alone gutshot or open ender or maybe a paint pocket pair, set etc...) he must have been pretty confident with his 4 kicker
