Remember that HBytes itself just wraps a pointer and a size, so
this does not significantly enlarge the struct, but it saves a whole
bunch of allocation.