Han, Zhu2018-03-122018-03-12December 22017-12December 2http://hdl.handle.net/10657/2922The next generation networks are required to offer a huge increase in the network's capacity. Therefore, efficient resource allocation schemes are required. Full-duplex (FD) transmission is considered one of the strongest candidates for the 5G networks to increase the spectrum efficiency. Additionally, largely increasing the number of active antennas, i.e., deploying massive MIMO is expected to increase the link reliability due to the high antenna gain and resistivity to the fading channels. In this dissertation, we study the FD transmission in small cell networks. First, we propose a power allocation problem to maximize the downlink capacity and define when the FD transmission outperforms the half-duplex (HD) transmission. Second, we derive theoretical thresholds expressions for the self-interference cancellation, the mutual distance between users and the spatial correlation coefficient between antennas that dominate the switching between the FD transmission and the HD transmission. Third, we study the FD transmission in orthogonal frequency division multiple access (OFDMA) heterogeneous networks. We propose a joint mode selection, user pairing, subcarrier and power allocation problem to maximize the sum capacity. Fourth, we propose a low complexity algorithm to derive the crystallized rate regions in a two-node FD enabled small cell network. Then, we study the FD communication in the massive MIMO networks. First, we propose an optimization problem that determines the optimum users' biasing value that maximizes the sum capacity. Second, we determine the necessary conditions to be satisfied for the FD mode to outperform the HD mode in a massive MIMO setting. Third, we study the trade-off between the DL transmission gain and self-interference cancellation via transmit beamforming. We formulate two rate-maximization problems to optimize both the ratio between transmit and receive antennas as well as the ratio of receive antennas at which the self-interference is cancelled. Finally, In this dissertation, we optimize the performance of the FD communications towards the 5G networks and we validate the performance of the proposed algorithms to define the gains of the FD transmission.application/pdfengThe author of this work is the copyright owner. UH Libraries and the Texas Digital Library have their permission to store and provide access to this work. Further transmission, reproduction, or presentation of this work is prohibited except with permission of the author(s).5GCellular networksFull DuplexHeterogeneous networksMassive MIMOOrthogonal frequency division multiple access (OFDMA)Power AllocationResource AllocationSmall Cell Networks2018-03-12Thesisborn digital