If no agreement is reached then the power to hold the referendum will not be devolved to the Scottish Parliament, he told the Commons Scottish Affairs Committee.
Holyrood and Westminster are currently negotiating the terms of the referendum.
Anything that is explicitly ruled out will be contained in the "section 30 order" - the legal instrument that will permit Holyrood to hold the referendum - while other non-binding issues will be contained in a separate "memorandum of understanding".
Conservative MP Simon Reevell asked whether a single question would be "a section 30 matter". Mr Moore responded: "Yes. I think it is pretty essential that in transferring the power that we set out what that power is."
Committee convener Ian Davidson asked what would happen if the parliaments could not agree on the section 30 proposals. Mr Moore said: "Then the legislation is not devolved. This whole process has to be approved by both parliaments. Without that the law stays as it is at the moment."