I want to create a combobox with a button to remove menu as the picture below
Thanks.
Don't try to edit the ComboBoxModel in situ. Instead, create a model editor using a two column JTable and the approach shown here. A JDialog would be a suitable top-level container.
ComboBoxModel
JTable
JDialog