perf annotate: Split allocation of annotated_source struct