Use a Burning Torch on it to light it up. Use other items on lit candles to put them out.

After releasing the item using four Red Candlestick Shards (each shard can be substituted with 90 mini beans), it can be crafted using Decoration on the Incomplete Incomplete Crafting Table or Crafting Table.

Burning Torch (1)
Flamo (3)