You can definitely paint your concrete. Plan that it is a slow process to brush paint into all of the uneven spots and may take 2 coats. Parts of ours was painted for several years until the finishing could "catch-up". We even anchored picture hooks onto the walls and hung some posters. I would be careful about gluing anything onto the floor unless you know what your eventual flooring might be. Glue clean-up can be a mess. Consider a carpet remnant.

Meanwhile, you will be using the space and imagining how you would like it finished. Use this as your opportunity to develop your plan, even anticipate finishing it in phases.

Try to incorporate as much floor and task lighting as you can. Many basements make the mistake of opting for just overhead lights, or flourescent lights, which make the space feel cold and clinical. And avoid junking it with remnant furniture which tends to make the whole space feel as though you're using it for storage. Invest in some decent quality, durable pieces, a nice remnant rug (with a good pad or it will feel hard on the concrete). you could even paint the floors if you wanted. Some tables, a few lamps and some color on the walls. It should look much more inviting. You don't have to break the bank either.

Don't know where you at but that seem liked a basement w/o any insulation if you going to paint the concrete wall.

Would coldness be a factor during the winter season? How was it before?