For Keymaster TA we are not going to add it in to unload pending list
as we should not unload keymaster TA and as soon as unload request come
we should release Buffer and return.

Change-Id: I7b1bf241f344dd4e9ce6b6781256218f9f41eefe
Signed-off-by: Nitin LNU <quic_nlakra@quicinc.com>