No. The custom dictionary, password screening and all policy settings are available whether or not NIST 800-63B compliance is turned on.

Choosing the NIST option in the setup wizard sets your policy to NIST recommendations automatically, so the wizard skips the screens for those settings. You can still change every setting in the console after setup. Turning on NIST compliance also adds a dashboard widget that shows whether each policy meets NIST.