At that point the exhaust gases are hotter then later on in the exhaust. With hotter gases or exhaust, you can run a smaller diameter pipe. The as gases get hot, they become less dense put higher pressure.
If you look at high end specific built headers, they'll be what's called "step headers" the first several inches of tubing will be smaller then step up to a bigger diameter. You enemy is going to be compression bends and lousy mufflers.