You can add the "Unicode Hex Input" keyboard layout, which lets you enter BMP characters by holding down Option and entering its code point in hex (similar to the hex entry on Windows). Expanding the Emoji & Symbols pane minitech mentioned also lets you browse by category (e.g. arrows), and you can customise the categories and add a full Unicode character picker (not limited to BMP like the Windows Character Map) there as well.