Thank you all for your comments on it. I went in to the doctor on Thursday (not my normal OB/GYN as she was out of town). She gave me some antibiotics, something for yeast, and tested to see if it was a yeast infection.
Cut to today: Things had not gotten better. It still hurt like crazy. I called them up and they had me come back in to see my regular OB/GYN. She took one look at it and said "Ohhh this is an abscess."
They brought me in the other room, where they had to open it up and drain it. Now let me tell you something. I have NEVER experienced this amount of pain in my entire life. They gave me a shot of novocain, but it only took the edge off as the abscess was located directly above my clitoris. The only way to take the pain away 100% would have been to knock me out with a general anesthesia but no one would do it for this I'm sure. So she opened it up and drained it. It's over, which is all I can say about it. They were wonderful people, brought in a woman to hold my hand, gave me hugs afterward. That was a good experience, but the procedure was a nightmare.
I'm feeling better now, though things are still sore and swollen as is to be expected. Hopefully in the next day or two I'll start feeling more like myself. I go back on Monday to have it looked at and hopefully there will be a huge amount of improvement by then!