Yes, of course, just dress accordingly.
Layered clothing is best so that as you begin to warm up you can begin to remove outer layers to help cool you down.
Light gloves and a hat to cover the ears and top of the head may be a good idea as well to help retain heat. Clothing that is made of “wicking” type material is good to have as the bottom layer of clothing as this will help remove any excess moisture and keep you feeling dry and comfortable.
If out door fitness is your thing, go for it, do not let the weather stop you.