The most common and most likely answer to this crossword clue is the 3 plus 6 letter word GAS HEATER
I've seen this crossword clue in The Guardian
G
A
S
H
E
A
T
E
R
More clues leading to the result GAS HEATER
Buddy explains!
The straight part
We know that "that’ll warm things up" is the straight/definition part of the clue. The straight part is often a synonym or definition, in this case that’ll warm things up = gas heater.The cryptic/wordplay part
In cryptic crossword there's often an wordplay/cryptic part as well.This part involves a more complex hint, such as an anagram, homophone, hidden word, etc.
Sadly, We don't have an explanation for this specific crossword clue yet.