The manual on my car mentions a capacity with and without a filter change. I use a Fram XG filter (gold can), which is smaller than the OEM filter and have had no issues. If you're not sure, I'd say fill the filter. Then, put the rest in the engine minus maybe half a quart and start the car. Turn it off after a minute and check the oil level. If it's a little low you can just add the rest.
My manual states 4.3 quarts w/ filter change and when using a smaller filter it comes out to a little less than 4 quarts.