pinctrl: core: Handling pinmux and pinconf separately