Two new Ocean State Job Lot stores, which were formerly occupied by Big Lots, will be opening their doors later this week.