Not sure what you consider a no-no with the IRS.
The IRS expects you to pay taxes on your income, regardless of where you earn it. It makes no difference to the IRS.
The no no with the IRS is hiding income. And if that includes a foreign residence - it is still hiding income. If you don't hide income, and declare your earnings - what could possibly be a no-no??