The most common and most likely answer to this crossword clue is the 7 plus 8 letter word FOURIER ANALYSIS
F
O
U
R
I
E
R
A
N
A
L
Y
S
I
S
Buddy explains!

The straight part
We know that "branch of mathematics" is the straight/definition part of the clue. The straight part is often a synonym or definition, in this case branch of mathematics = fourier analysis.The cryptic/wordplay part
In cryptic crossword there's often an wordplay/cryptic part as well.This part involves a more complex hint, such as an anagram, homophone, hidden word, etc.
Sadly, We don't have an explanation for this specific crossword clue yet.