Simply pass an empty BoxConstrains to the constraints property and a padding of zero. IconButton( padding: EdgeInsets.zero, constraints: BoxConstraints(), )