mlxsw: spectrum_switchdev: Fix port_vlan refcounting