Hi,
Don't know if this is the best way to do it but here is how I would go about
it.
Delete the off page reference.
Go to the originating reference and double click.
You should get a popup "Off Page reference" dialogue box.
De-select the "drop off page ref......" radio button
Click the ok button.
This will retain the link without displaying the icon.
Hope this helps and was what you were looking for.