Prime Minister Jacinda Ardern says she is not directly considering a fireworks ban, but we should keep an eye on them.
"As a kid I loved it; as an adult, it's a pain in the butt," she told the AM Show on Monday
"I want to have a look at what kind of callout rate we've been having, how many kids ended up in hospital. Yes, I think public displays are fantastic - but I do think we need to keep a watchful eye on whether or not it's costing us too much."
Fire and Emergency New Zealand responded to 125 fireworks-related call-outs in November so far - already more than the whole amount for the same month last year.
National advisor for fire risk management Peter Gallagher told The AM Show there were 58 call-outs during Guy Fawkes on Sunday night - a number slightly higher than expected.
Mr Gallagher says call-outs during the sales period have declined since 2012, but the shorter sales period has condensed call-outs.
"The biggest problem for us is we get multiple call-outs at the same time, which stretches our resources.
Watch the full conversation on the video above.
The AM Show with Duncan Garner, Amanda Gillies and Mark Richardson, weekdays 6-9am on RadioLIVE and streaming live to the ROVA app on Android and iPhone.