The solution is one that is also used in English: use of an adverbial or prepositional phrase. These phrases are typically formed by using preposition and a noun, sometimes including an article. For example, we might say anduvo a la izquierda, "he walked leftward" or "he walked to the left." In that case, a la izquierda and "to the left" are adverbial phrases. The difference is that in Spanish, there is no one-word adverb that can be used.
Adverbial phrases seem to be more common in Spanish than in English. In many cases, the same thought can be expressed using either an adverb or an adverbial phrase. Spanish tends to prefer the phrase, while English tends to prefer the simple adverb, even though both are grammatically correct. For example, it is possible to say either ciegamente or a ciegas for "blindly" or "in a blind manner." But Spanish more often uses the phrase, English the one word. Even so, in most cases there is no practical difference in meaning between a -mente adverb and a corresponding adverbial phrase, so they are freely interchangeable. In many contexts there's no distinguishable difference, for example, between perfectamente ("perfectly") and sin errores ("without mistakes").
What can be particularly confusing for Spanish students who have English as a first language is that the two languages frequently have similar phrases that use different prepositions. For example, the phrase for "on horseback" is a caballo, not the en caballo you might expect if translating the English "on" literally. Similarly, the phrase for "kneeling" or "on the knees" is de rodillas, not the en rodillas that might seem logical.

