What WWII and two atomic bombs could not do, the Japanese are doing to themselves. With virtually no in-migration, the falling birth rate has caused an actual fall in population. With a very aged population remaining a short term increase in births is extremely unlikely.
Europe is next and maybe even the US because children are no longer valued as they were by previous generations. Why take the responsibility for a little human if he or she interferes with your career or vacation plans?