September's inflation figure of 3.8% was unchanged from August. The Bank said the rate had peaked and predicted it was likely to fall "close to 3% early next year" before gradually returning towards 2% in 2027.
Policymakers said the decision to hold rates at 4% was down to wage growth continuing to slow and price rises for services easing.
But it warned the current rates of wage growth and service price inflation needed to fall further for policymakers to be "confident that inflation will fall back to the 2% target".
Yael Selfin, chief economist at KPMG UK, said the close vote "underscores the uncertain backdrop policymakers are navigating ahead of the Budget".
However, she added the Bank's comments suggest "the door remains open for a rate cut at the December meeting".
Analysts noted that by then there will be more information on inflation and the jobs market to assess, as well as any measures announced in the Budget.
Paul Dales, chief UK economist at Capital Economics, said November's decision was "a pause in the downward trend in interest rates rather than the end", adding that the Bank "will probably resume cutting rates in the coming months".
In its latest Monetary Policy Report, the Bank predicted UK economic growth would be 1.5% this year, but estimated it would fall to 1.2% next year before rising to 1.6% in 2027 and 1.8% in 2028.
The government has made growing the economy its main priority as part of its efforts to boost living standards.
The theory behind increasing interest rates to tackle inflation is that by making borrowing more expensive, more people will cut back on spending and that leads to demand for goods falling and price rises easing.
But it is a balancing act, as high interest rates can harm the economy as businesses hold off from investing in production and jobs.