Is it spiritually wrong to want materialistic things, to be passionate about worldly things?

Spirituality is not anti-materialistic. Spirituality is not anti-enjoyment per se.

Spirituality is about freeing the mind. Spirituality is all-inclusive and not exclusive. It is not wrong to want materialist things when you are on a spiritual path. The whole concept of spirituality is to be centered - not getting swayed by too much pleasures nor forcibly running away from enjoyments.

Craving for anything or being averse to anything puts you off your center - because either way, the mind is stuck. ( contrary to being free) When you are on a spiritual path, with regular practice the external attraction will cease to tempt you anymore than what it was at the beginning. This will come naturally with wisdom, guidance of the master and the practice itself. Once the taste of inner world is got, the external will cease to to attract you with the same intensity and feverishness. Striking the balance is the key.

Feeling guilty doesn't really help as the mind is stuck in the past. Feeling feverish to enjoy something in the future will also not help. Accepting whatever the life has to offer and being totally in the moment is being spiritual. But the key is not to let any events get stuck in the mind in terms of craving and aversion.