A universal time-domain windowed orthogonal frequency division multiplexing (UTW-OFDM) has been proposed as one of the new waveforms to drastically reduce the out-of-band emission (OOBE) for the 5th generation mobile communication systems. Meanwhile, the conventional UTW-OFDM with a symbol overlapping process requires an additional memory for storing successive windowed symbols to ensure sufficient effective CP length. For the forthcoming ultra-dense small cell networks in the 5G, a more simplified yet effective new waveform is required. In this paper, we propose a new UTW-OFDM without symbol overlapping process to simplify the transmitter architecture compared to the conventional UTW-OFDM. The performance of the proposed UTW-OFDM is characterized by simulating OOBE, inter-symbol interference (ISI), inter-carrier interference (ICI), error vector magnitude (EVM) and block error rate (BLER). The simulation results show sufficient OOBE reduction in the short-delay multipath fading environment and demonstrate the applicability of the proposed UTW-OFDM for small cell networks.