Its hard to tell your modeling because there is so much junk on the layout, it looks like you have just dumped a trashcan of stuff on the layout then took a picture of it.
Finish a scene then ask for feedback. Hopefully you aren't attaching your track with rusted carpet tacks. You can use latex adhesive caulk to glue down the track (not switches) and use tacks to hold the track until the adhesive sets.
Buy a straightedge 18-24 inches long and use it to align the rails or ends of the ties to get straight track.