Limited observational studies have described the relationship between sleep duration and overall diet. The present study investigated the association between sleep duration on weekdays or social jetlag and empirically derived dietary patterns in a nationally representative sample of UK adults, aged 19–64 years old, participating in the 2008–2012 UK National Diet and Nutrition Survey Rolling Programme. Survey members completed between three to four days of dietary records. Sleep duration on weekdays was categorized into tertiles to reflect short, normal, and long sleep duration. Social jetlag was calculated as the difference between sleep duration on weekends and weekdays. The association between sleep duration/social jetlag and dietary patterns, derived by principal components analysis, was assessed by regressing diet on sleep, whilst accounting for the complex survey design and adjusting for relevant confounders. Survey members in the highest tertile of sleep duration had on average a 0.45 (95% Confidence Interval (CI) −0.78, −0.12) lower healthy dietary pattern score, compared to middle tertile (p = 0.007). There was an inverted u-shaped association between social jetlag and the healthy dietary pattern, such that when sleep on weekends exceeded weekday sleep by 1 h 45 min, scores for indicating a healthy dietary pattern declined (p = 0.005). In conclusion, long sleep duration on weekdays and an increased social jetlag are associated with a lower healthy dietary pattern score. Further research is required to address factors influencing dietary patterns in long sleepers.