We should validate this explicitly and generate a clear error string, rather then hit an assert() later in the code.