Since its start in 2010, the British-American period drama "Downton Abbey" has continued to build a strong following on a worldwide scale, which is a testament to its critical acclaim. While a majority of the same cast will be officially returning for the fourth season, it's being reported that one of them may not be continuing much further.