Rep. Tim Moore, the longest-serving House speaker in North Carolina history, lost his bid to keep his congressional seat after one term.