I suggest that you start with a microcontroller that can do divide, such as one of the 16 bit ones.
If not there are divide and multiply routines at
PIClist, Microchip PIC
The accelerometer has an output of 800 mV/g, and a range of +/- 1.5g, so its output voltage range must be +/- 1.2 V.
You haven't said what accelerometer it is. There will have to be a defined output voltage for 0 g. If that is in the range 1.2 - 3.8 V, then the output will stay within the 0 - 5 V range of the ADC. If not, you need some sort of level shifter.
If the output is 2.5 V for 0g, that give 0x200 as the output of the ADC. So the acceleration is ([ADC output] - 0x200)/0.8/1024*5
The tilt is arctan(accel(y)/accel(x)). However, that function is impossible to calculate near 90 degrees. What you have to do is work out which acceleration out of accel(x) and accel(y) has the largest magnitude, and divide the smaller by the larger. Then you have a number between -1 and +1, so your arctan function gives a result in the range -45 to +45 degrees. You then add the right number of 90 degrees depending on the signs of the accelerations.
For instance, say accel(x) is 0.6 and accel(y) is -0.8, accel(y) is larger in magnitude, so you divide 0.6 / -0.8 = 0.75 and arctan (-0.75) = -37 degrees.
As accel(x) is +ve and accel(y) is -ve, you are nearest to 270 degrees. Because you have divided by accel(y) you need to subtract the angle. That gives the tilt as 270 - (-37) = 307 degrees.
**broken link removed** has some arctan functions.
Tilt in 3 dimensions is has three angles, so more maths is needed if you want tilt in 3 dimensions.