I can't remember where I saw it, but I saw something similar that's used for laptops, but for desktops.
Basically it was pad that you screw down into the back/side/where-ever of your desk and it has a loop. You then run a security cable through that loop and then thru your desktop.
Go on Ebay and type in 'Desktop lock' and you'll see what I mean. There's auctions for black pads that you just glue to your desktop to add a 'loop' to run the cable thru it. You may want something more permanent than a glued on pad tho.
I've also see USB port locks. It's a little insert that goes inside the USB ports of the desktop so jump drives can't be inserted into them. You have to have the special tool to remove the inserts. In case you didn't know, almost all newer computers can boot directly off the USB port unless disabled in Bios and bios is pass protected so it can't be changed. Someone boots another OS via jump drive, and voila....they have complete access to all of the files on the internal desktop HDD. They can then copy files to the USB drive. This is also possible via CD rom image, but it's a little harder to copy files (unless you have a CD and USB jump drive) yikes...
There's also cord/cable lock systems that I've seen. All of the cables in the back of the desktop lock into it. Makes it so someone can't steal a keyboard/mouse, etc...
Now if this is for your personal house PC, you may just want to bolt the case to something. Either the desk or right to the floor depending on how secure you want to be.