Using a server is not mandatory with the SIP protocol, and you can definitely set up a point-to-point link without such server. Just use the IP address of the destination codec to set up the link. There is no need to disable the SIP protocol! Even not using a SIP server, you still benefit from the automatic negotiation of the coding parameters, and do not need to handle details such as UDP port numbers, etc.
