I would say there are 3 distinct aspects of life which can be labelled with hope:
Hope that one's individual situations can improve
Hope that society at large can solve its own problems
A form of existential hope, i.e. that the Universe is fundamentally good, that love is not merely a human experience but something deeply important to its own nature
My position is that 1) is undoubtedly true, 2) is completely false because the technological system is inherently unsustainable. And my intuition tells me that 3) is true, though it is worth keeping in mind that I have various biases informed and reinforced by my reading, and thus my “intuition” could also be the result of a form of echo chamber. I think ultimately, aspect 3) can only be experienced through living, although we can try to point at it as best as possible through various metaphors and ultimately, art. But it isn't well suited to short-form non-fiction writing, which is why I won't say more about it.
As for 2), hope for societal prosperity, this is essentially what most of my writing here points to: the coming decades are going to bring the decline of the modern world, because its relationship to the physical world, mainly being extraction, and to human beings, coercion, are inherently unsustainable. And that form of "hope" creates far more suffering than a way of living which accepts hardships, is willing to let go of the luxuries of the modern world and focuses on what one can do right now in their own life.
I would say there is a rather deep incentive structure for hope in the current information ecology, which is that people who sell ideas sell hope because it makes the readers feel good about their own lives. They are not incentivized to solve problems or tell you what you need to hear1, they are incentivized to be good at spreading their ideas, and it is incredibly naive to believe that the truth spreads the best.
The truth is the best at playing the long games, because it is what is the case, by definition, such that only time and the conscious experience of it, can reveal the truth. But in the short-sighted games of our times, it is not truth which prevails, which is why I do not believe in the virtue of hope for our society, though as I have said, I know I can make my individual life better, and I trust in the Goodness of the Universe.
Footnotes
1 Ultimately everyone sees through the world in a partial lens, and I am not so arrogant as to think that I can see the truth in what is going to unfold in the next decades. However, I am certainly not bound to an agenda of appealing to society and what it creates, and appealing to the ego and what it wants to cling to. It's usually best to look at the dynamics of the ego through your own life, since that merely requires your own discernment and some honesty, and then examine how those build up to the collective ego dynamics that shape our world, which is unlikely to be what you want to hear.