(1) cannot be replaced by "hang". "Embedding" means putting something smaller into a recess on something larger. With the word "embedded", you can write a flashing thought and remember a profound artistic conception in the poet's mind.
(2) Bing Xin wrote the stars in her poems to show that many fragmentary but shining thoughts left a deep impression on her mind.