kind of rake, loquat
杷 centers on a tool for gathering or a specific fruit: a kind of rake, or the loquat tree and its fruit. The two meanings are distinct, connected mainly through the shared character shape rather than a single conceptual core.
杷 combines 木 (tree/wood) with 巴, which likely contributes the sound. The character originally referred to a wooden rake, and later also came to represent the loquat tree.
A wooden 木 tool with a curved, grasping shape like 巴: picture a rake made of wood, or a loquat tree with its broad leaves and clustered fruit.
For ハ, imagine a gardener laughing 'Ha!' as they rake leaves under a loquat tree: Ha -> ハ.